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© Rendering a co,or image for an output mediun, from symbolic image data. 
® , A -mod of ren^ a colour irnage^a ^ 
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A method of rendering a colour image on a 
debited output medium (49) h - **»d 
wWch maps colore to the gamut 
Sated' ^•^SJft CKS 

m»Hn«ds at the point where information about 

5£*M& Snd their ^**£\S 
a «srene description s available, but alter itib 
fijf mnc f geometiy has been determined by 
ml rendering ^Te^The method makes use of 
SS^SpUt of ■ symbolic tendering system 
which pmduces symbolic pixel 
rem having basis spectra variables which recre- 
ant' tte Xplay <& light and object jrnotag- 
in the scene description, and spectral date 
having colour Information about the 
object primitives in the scene, and wh,<* i * 
i j *hft hasis soectra variables. me 

££* change ojtoMon. 

S *e original spectral data that need to be 

toc^rand globally consistent with the seman- 
ticTof the image, make effective use of as much 
7the available 9 gamut of *E^#S**S 
nossible and requ re no further post-renaenng 
STA Prior to display or reprcduct.cn 
on the designated medium- 
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The present Invention relates generally to the f IpIH of * 
comber-synthesized co.or images, •^^^i^S^Wf , " ^ to tte w * rt, « * 

color Images having image colors which are ln!he cc toSZl 5 1, T ' c^Puter-synthesbed 
for implementing such a method color gamut of a des,g na ted output medium, and a machine 

ofreansT^^^ 

The broad functions of the typical. COTputeNteseTirrSfc™^ the en ° re ran9e of visible <"*<«*■ 

with reference to. FIG. 13 of USSN ^Tea^Zr^T ^ "? ''""^^ in ' and describe < 
application. As a scene is constructed by the scene fZtaL « J V °? Py ° f ¥ * teh filed wth the P™*nt 
object primitives, and relationships among theT t£^ZLT ^"-Tf^ 61 ^ 66 ^^ 
stored in an application database 22 coZins d^crinhw « box 2a The scene Ascription, 

^cts.andlightsourcesinas^en^ 

and connectivity relationships that sKroWec^mS^ 
scene description must then be conveTtedTntoS 

medium, typically on amonitororinhardcopyform^ ima9e on an ou ^ 

Pixei file Is typically refers to as "renS- and KeOZlTZ"* ^ deSOripH ° n to an 
derer. shown In FIG. 13 of Ref. 1 by Shm !box 24 ' mp,ementahon rf ^ndering isreferred to as "the ren- 

As can be seen from the functional steps illustrated in FIG 1 3 nf R-f t 
may want to make to the Image that affecUha ohltert . J a " y Chan9es that a 8cene designer 

20 objects, will mean changing the sceneTes^n " the ' ma9e ' 8uch 88 the colours of the 

putationaily expensive procVdJr ^ ThTs tc3es Itino ^ 22 "l" re - renderina the ^^ge, which is a com! 
information about objects. iM^S^^^J^^? 0 ^ " ""^ Si " Ce 
changes to the image made beyond rendering oioeLe 24 mlfh „ f!" 6 descri P tion 22. Alternatively, 
object or lightsource colors at tL pixel le«aestil^ 
2fi designer to accomplish accurately maintaining the .mage realism, is difficult forthe scene 

the entire Image. This methodX^ «P— of re-rendering 

Ray Tracing", Proceedings of SIGGRAPH 1989 S V 31 A^'f o«2 I ^ K ^ h "^^rfeed 
23 (July 1989). pp . 307 - 314, (hereafter 42i? n St0 " MaSS - ^P^r Graphics 

reference to. FIG. ! of Ref. 1. Briery the me^h^ moaWasT ' s . l,lus I tratet, «"d ^cussed in detaiFwith 

the medTum. ^^rS^ofT^LZ^T "*« ,S — < he — W of 

which are possibie in - S^?^^SS^ ?*^ ,B, * r *" the set * - -sibie coioJ 
the output medium on which it Is IS^^il^^K^^ inde P end °<% of 

dering process 30 for modeling the light ^ZToXi^^^ ^ a ' 9orithms use « shaded ren- 

for the c^lor of one of the objLs pul S 
the output medium, or that LZ^^Su^^^S^^^ ^ th ° C0 '° r 9amut * 
stances, a "gamut mapping" process 40 is nec^ssarv to ^SS^lT* 1 T ' mga0ve Value - ,n most in - 

Thus, as shown in FIG. 1 of Ref 1 the 3 ^ ^ subsequently displayed or reproduced, 

to the '(Mo^mZ^'^Si^lT^ PKel f8e 32 m ° St ,ite,y w "' need to b ° "»PPed 
color gamut of the output M^^^S^^^ app,les informati °" ^ the available 
to bring out-of-gamut pixel cotorJSlh^.Sl2J5 55££ TT" maPP ' n9 a ' 90r,thmS ° rter 
of datafrom a sample set of actual colors from tS Sta^^^ , ,^° B 5™ ,Ut ^ f " e 44 ,S comprised 
measured by an appropriate instrumen7Iu C h « « ^ 9 T ofthoou 'P"« medium which have been physically 

output medium. Since each device gamut is d.feren, T^^^JZ'^i^ 
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mated gamut mapping pro^^ 

overall appearance of the Image The ^^^^J^X bee " a proCeS8,n9 9 °* of the , 9raph - 
volved in the reproduction or display of color, m ages, and ™ fem 25 (FIG . i of Ref. 1). nor a 

,cs rendering pipeline 24 (RG. 13 of Ref > « '^JS^^^ai^ typically by using various 
primary concern of the scene des f^^^^MMOior locally modify individual pixel colors without 
automated methods implemented In Ga mutma PP ing may also be accom pi .shed 

regardtothecbjectelnthelmage^ 

manually. Typically, the gamut of the output device is iwn ■ j common automated 

EE "n a cotor space, and pixel colors are ,P^--^^Xh-^ such that the pixel colors 
£mut mapping method h . region in the coior space, and all 

most outside the gamut volume of «"» d ^3 soa|lng is conceptually similar to "turning down the 
other pixel colors are scaled In proportion. X ^*^^ a Z M scaling of the image pixe. colors dark- 
Hghf in the scene description. In some. "P"^™"*^ Smnon automated gamut mapping method 
ens and desaturates the resulting , image ™^^Xd^^y^n^^^ M, * tta r!f 
Involves the'local One undesirable effect of most methods 

Is no longer semantlcallyco^ 
semantic inconsistency and problem with the exiting ^pro RG. 2 thereof, 

having out-of-gamut colors is discussed ,n deta m Ret objeots and als0 conta ning re- 
Forexamplajnasynthesized .mage contain^ 

flections (56and 58) of these objects in •^SSSoSlSooIoum of the "real" objects. If the colours erf 
the colours of the reflected objects are semant.ca ly ~" 9l ^ c cor[80tin g tne colours using uniform globa 
he real objects are not in the gamut of V^L^^^STa. their reflections, and darkening of 

scaling of the image pixel colors will «^^ST K K«I «* °°"*<* on «" °" ,y "V* 
the reflections may result in cons.derable loss of object «>u ^ device ^ result m a 

„ of^amutfred) pixels of a certain objec Q ^ betweenthe 

semanticallyinconsistentimagev^ 

relative brightness of the objects than what .s ^ n ^J«^™ oorr ,pleted. a user might manually control 
of-gamut colors. Alternatively, ^r the rendering of he -mage * P and er(Wand using artl8 tlcjudg- 
paLeters In automatic mapping ^^^^S^^^^^^^^^^^ 
35 ment, the individual out-of-gamu p.xel f .^"SSiSrtto consistency. This solution, however, rarely 
in-gamut in a manner which ach.eves or a,most ^' e ^ e m fty of th e task, and requires a manual adjustment 
Uvideshnagesemanticconsistency ^^^XSmdlttm relatively unpredictable nature of ^e 
step which typically involves con«*rtbtot™ I and ermr nderlng garnut mapping process can 
changes involved. Thus, lnta™n-c«on of light in the scene. 

« arise in most rendered scenes which •^^^"£1 8emantio consistency of object colors and l.ghte 
One method for achieving both .n-gamut pixel reprodu c e d. is for the scene des.gner to 

in the image for the device on which the image .s to be **J££Xn dafc3base in order to bring the out- 
fry to make color changes to the objects in he <™&*£%^ fe u P sing a symbolic rendering system, such 
of^gamut colors of certain objects .n gamut, f th J«"^J£ would not be necessary, but manual adjust 
m as the one illustrated in FIG. 1 of solution of changing the scene descr.pl.on 

ments to the colors in the scene would .tfl be ^^ e ™ n(ja , adjustrne nt of the scene descript.cn or the 
produces semantical* consistent .mages, . ^^^^J, especially if re-renderlng is Involved 
symbolic pixel expressions, wh.ch can be a time consuming p ^ ^ desoriptlon 22 (FIG. 

^Because the spectrum, or ^^S^^^>^ to£me "** TftTa" 
. 2) may appear in more than one symbol « P^JJ^ xe , colors whicn „ er e formerly in-gamut butbe- 
rect some out-of-gamut pixel colors wh,le , p ^"" n9 ~ ner ^ blem of directly modifying the ong.na color 

satisfy the image metric. « nr winn a color image with semantically consistent object col- 
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The present Invention provides a method o7 ^7^ ? ^ 8PWMtorai,Mln,ents - 
to claim 1 of the appended claims * 9 8 Ct "° Ur lma 9* from symbolic Image data, according 

map^c^^^ 

information about object primitives and t So22t a r^" 9 ^ at the point where 
point where the fixed scene geometry has Wdb22£? k SCene ^P" 0 " is ^aHable, but after the 
the method uses the symbolic odor image Sate an Tthe S^" rendenn9 me,h0d - Preferabl * 

bollc shaded rendering system. The iffi^^^W^ whi ° h h 5 e the -P" * * ^ 
reotyrepresenttheinteiplayofllghtandob^ 
data comaln the light intensities and ^ 

*om the scene geometry ■XSS^£22 KE^'"? J* 1 * ^ 8epa ' ated 
«f lers such as indices. The method of the ' ^f" 0 ^ data via uni « u e Wen- 

and color values have been separated Zn tot sZtToZZ °" that - since the 'W* 

spectto the color gamut of a parfo^e^i™^ 9e ° m ^' * hey are avai,able for modification with re- 
modification made to the "he Ibh ^n So ESS ?' ^ th6 ^ ° n the ori9ina ' scene <* «*y 
Thus, the method also uses 'X!2 ^SSf^JS^'f * Symb °" C 
Using the symbolic color image data, tSr2^2JS£ * I?" f™' ° f ^ 0O, ° r OUtput medium - 
od performs spectral iimnaB o,^^^^^!^^ " deV ' C9 9amut data - the me »- 

produce colors which are i the gamTtffhec^ 

color Image data in a later step, will generate a terneS ZJS^h u"' Whe " US8d W,th the svmbo «o 
colors in the gamut of the col reprSn deS BelaZT k ^ ter9et COl ° r is one « the devl <* 
hire information in a symbolic form « the olfecTorirn^ T?* 0 P ' Xel ^P" 588 ^ 80 maintain pic- 
values which are subsLted ^^^JSSZ^^ ^ 4 ° 00tour a " d " 9ht inten9ltv 
image, thus changing not only obj JcXrTb^^ 
buythe changes In object coloL. This SS^Stt^od^rf^ * ,ta ' W thrt TO 
changes all of the appmpriate symbolic colo^ wheS^^^^ 

All image pixels which have light contributions fo^Tn obfect 1 T* 0 " 0 pixe ' e *P ressi °"s 80. 

changed, and the image remains semanSy existent whl thT^n * t"" 8 "' C ° , ° Ur value are thus 
ignated output me * 00nslstent whlle tn e colours are brought in gamut for the des- 

w^n^^ consistency in each rendering. 

sections to represent Informing Z^Xt^'^T^T "* aSS ° dated «"*» d - 
duces image pixel colors which make effect LI TfT re,allo " s i h, P s in »•» rendered color image, and pro- 
is possible, and require no^h^SSZ^u? 9amut of the device as 
Jnaddiuon.theauLatedpro^ 

formed again to reproduce or disolav the imaof «wTT^ con » stent . 'n-gamut images can simply be per- 
ame-consuming manual ^^S^Z^SS^SSIS — «»« tba — * ^eat 

*lns^^ 

nated output medium, without theTom^ lni?SC^^ 
consuming post-rendering step of manual pixel color *n«Z£*T ^ ndenn 9 ,he ""age or the time- 
maintain picture information in a ^^ZmauZXT^Z^ T^" 0 pta ' expressi ™ 80 
intensity values which are substituted in the £™ of t hi !ln ' ?"* ° han9eS to the oolor and 

the color image, thus changing no^JJSK^SSSIT! " ""J" 9 " at 0 * ot ,eVel h 
affected by the changes in object colors This ocr„™ ho,i * 9 u 9 ' he P ° rtl0ns of the ima 9 e tnat «■ 
taneously changes a° of th«2S5^^lS^?S?^ iELr tl "l B0 rf th * P ~ nt rtmul- 
presslons 80. All image pixels which have EuZZZ?? ? wherever they occur in the symbolic pixel ex- 
are thus changed, and K^SSS^ object primitive with a changed colorvalue 
the designated^* oSEZaZEZ!^^ « brou 9 ht 
of an outdoor street scene in FIG 2 Tfo? a II« « » T f? reCtod randenn 9 for rendering the image 50 
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bolic color imagedatawiththeindexed^ 

our imagedatatogenerateacurrent color image «^ 

va ab.es being applied to the indexed colour d *^J^3i. fromthe current coiors of 
image data Items; and generating a target color Image ^ gamut of device colours of a colour 
the current co.or image using the device 9^^^^^ ttget colour image being one of the 
reproduction device; each of the plural.ty ^.^^^^cciattB of thecurrent colour image. Then, 
device colours in the gamut and c°" es P ond,n9 ^"^^7trrget colors is calculated. Using the difference 
calculating difference data bet^ 

data, incremental change quantities for he ^^^^^^^an^^^f™ 
next set of values forthe change vanables A^t ^\es lrnage metric data. The image met- 

the incremental change '^^f^^^SSZl* terms of a relationship between the cur- 
riodate includes relationship data fo^ 

rent color image and the target color ,mag °^™^ r image do es not satisfy the image metric 
quantity for the incrementa^^ 

data, then the incremental change ^ nt,h ^ a « apP JJ . P mtlte fe not satisfied. Once the image metnc 
and the above steps are repeated again, as long ^ the symbolic color image data are applied 

is satisfied, the current values of the change variables artoiwd t y description data. 

to the corresponding indexed color ^T^J^SSSS. ^rTis provided e method of operating a ma- 
in accordance with another '^ a0 ^r^^ amx ^ to claim 6 of the appended cla.ms. 

determining en Incremental ^ an 9 e ^ uantlty !^T l * rf the change variable to obtain the new value, 
the incremental change quantity to he current value ^^^^^.^ ptxel fun ctlon of the change variables 
Preferably, each ^ te ^^^J^SS^Si an incremental change quantity includes 
and the symbolic spectral °°"P°" e "^ ^£ n0 « o Sh respect to the change variables therein to pro- 
the steps of (i) differentiating each s ^^S a jac ^ bian ^ in the memory of the machine 
duce differentiated symbolic p.xe *«fX2 nmSJ2 B and store in the memory of the machine a pseu- 
from the differentiated symbolic pixel ^^^j^STi^uaUna the pseudo-inverse jacobian matnx 

srrra^ 

"Preferably, the desired re,a«onsh,p represenfcd adding on" 

'^blyX^^ 

change variables with initial values hav.ng no modff teabon ef e « o / ^ the jndexed oolor 

« evaluating each symbolic spectral ^^^^^ c °o o data'items composing an idea, color inv 
description data items to produce a P'^^y cf Wea ' ™* and wherein the image metnc data 

age; and (a.3) storing the idea! .mage pixel cc,o^ 

representa desired relationship betwee the ^^SSllth.tagrt color Image, 
color image and the target image pixe cd or processing device when suitably program- 

« The present invention further f^J^^ a ^ n e above-described particular embedments, 

medfdrcarryingoutthemetho of^^^^^^ 

In accordance with still another aspect ot tne p appended claims, 

a colour image from symbolic image data, a ^S siri dwLal object and light source scene spectra 
In summary, the method of the present .nvenbon moditos md iv a |e Q( . repro ducible on a se- 

«, in orderto produce a rendered ^T^Z^^X^ ima9e piX6lS - The ima98 

iected output medium without an ^^"^S^S insistency among the objects in the image 

produced by the method Pf eserves t sernan ^ r r ^° a * file in the output medium's gamut. By changing the 
while taking advantage of the w.dest^^^^ ghadl arBfacte „ .voided and 

scene description rather than Indlv du al ^ag. ™° ; n maticity , in oer tain instances, are permrtted. 
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directed rendering according to the present invention; 

Figure 2 is a block diagram illustrating the functional steps for the method of a 

shown as block 90 In FIG. 1 ; rnernoa of device directed rendering 

Figures 3 and 4 diagrammatjcally illustrates using weighted vectors a«wrfi„„ ♦ 
e present Invention to represent colors in a color sdJa .„h! J r - * ac * ortiln 9 to embodiment of the 

Figures 5, 6. 7 and 8 concepL^sh^te J ^ the We ' ght8 10 chan 9 e ,ho ««*»: 

embodiment of the meZoUne JESSES *" ,ma9e ' ■**■* fUn ° tton used aoc °*'"9 •» a " 

cording to the present fr^enS configurations which may be operated ao 

m tiT 13 ''I. 8 '' 8188 sohematica "y representative data structures used by the present inventor,- 
in F G Tthedfv me d nUm !T h ~ ^ U " d * ^ the 8a ™ *™E 

*s tion data 84 and symbolic color imaqe date cal M «™hnuH , ■ d escnpton in indexed color descrip- 

s^m, and device gamut c ^ 
method^ 

s«^ 
^UepbceicT^^ 

Hally all in the device gamut of device 49 The 2.J JT w u haS PKel colors wnicn are substan- 

^ned^^ - «« origins 

fied, in box 94. The detaiis describing one way T^cXe^^T CO,0rdescri P Uon data 84 Is modf- 
with respect to the illustrated embodimen^^ T^" ,ssetfort " "e!ow. 

» which. whenallofthem«iifiedcolordeS^^ be modlfied in a ™""er 

acolorimagefordisplay in symbdic D^«»«![on I! < ^ ~ "fsymbol.c pixel expressions 80 to produce 
boiic pixel expression eva3 8 2 is ^SS^S^SJSh ^ "T' * ProdUWd by Sym - 

the coior descriptions w.,1 be modtf iedTa^anne^ 

44, although they may be adjusted tomeetolher sifc^f nl^tlr ^ dSV,0e 9amUt 

to the values of the original colors In Indexed clrdS^^^ f dlrecflv ™«° 

Sx^^^^ 
the rce?f^eT^ 
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of the dev.ce directed rendering method of the present JrrvenHon by device gamut 

of the objects and lights in the rendered .mage wh,ch a e | , he devtae t ^ nus> the 

data 44, and which produce an image wh,ch.s ^f^;^^ acceptability to the 

validity measurement crfthe image metn*^ 
userofthemethodJnoneembodimentofthemethoathe^ 

„ stated in terms Jjr - ^J^^^^SX^^ ^ ^ T 

color image, also called an ideal coior image, may u y i„ dfflced color descriptions 84, prior to mod- 

of an arbitrary » " • -^^J^ « modKied are the color 

of the indexed color descriptions that ^^^^^^X^f^ma^t color image 

^method of the present ^^-£2^^*"^^ 

the symbolic pixel expressions 80 and the mdexe colo 1 d ™^~ ^ in w . ! wlth reference to 
SC ene description database are accomphshed ,n the same ™"™ *J^™ faf oreating images . The 
FIGS. 12 and 1 thereof, utilizing known modelmg painty " 0 ^™ S mp0 nents, objects, and light 
scene description contains descriptions of ^^^^S^^o^. and surface texture, 
sources In an Image, appearance attnbutes of the primitives ■£^™^ to * r in tne lrnage . | n the illu- 
and connectivity relationships that show how ob ects are ^ positfoned ^^J^So*™ 1 tne input to 
strated embodiment, each color of an '^^^^S^ZS^ For an il.uminant, 
the symbolic rendering system is represented as « •"^^SlSa eurfats., the spectrum represents the 

r u p n=x^ 

a modified ray tracer* P ^ 

'""An indexed is assigned to each unio,e color ** = £™ £ ^ ™ ^frC^ESt 
The indices along with their - 8 ° clated ^ 80. FIG. 13 illustrates 

dexed color descriptions 84 as shown, or "j^^ 1 "™!"^^.^^^ descriptions. The number 
arepresentative structure fortheflle84 of dateKerr^^ 

of indexed color description data items depends on "^^^T^a is composed of an index field 
exist in the scene description. A single ^^StSS^Z grated data f ieid 266, the coior 
264 and a color, or spectrum, date f, eld Z6 ^^?°^ formglt suItable for representing and encoding 

aTy'off^ 

Each symbolic pixel express.on re P rese "* reflections of the light propa- 

at that pixel, or, more P*2»^ ; d th P e symbolic pixel expressions 80. the 

^^ZS^^Stt* 1 " of the scene surfaces and the ,i9hte to form 
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IlllBfltaii 

FIG. 13 illustrates a representative data structure for symbolic pixel expression file 80 Astod! 
pixel expression 252, representing the color information for a single pixel lXSori££ H ^ composed 0 f 
basis specfra terms 254 and arithmetic operators 256. Each basis spectra term 254 in dude! one orT~ da ? 

^cSLZSLT 110 ** ?i he symbo,fc renderi " 9 system n °< d,reot * 

he scalars c, and discussed above, and one or more symbolic spectral components 260 which J* i„ 

SSEXIT C ^ deSCri , ption data * Th. use of a'n k^^T^SSSSi 
encing between a symbol.c pixel expression 252 and color description data 84 is an efficient bJ^rZ^L 

SET*? CO, ° rdeSOri P tfon data the « pixel expressions ^V^SSS^SSZ 
Indirect referencing arrangement may be used for associating the actual colorand light Irrtensft^'aTuLlnSor 
d^riptionda^4 to the corresponding symboHcspect^ 

symbolic special components 260 are used for indexing into the indexed color ^eacrlpfcn Tshown 
'. W corres P ondi "9 ^information data, or spectrum ^^Tto^u^Z 

symbolic pixel expression to produce the image pixel color evaluate the 

descriWnfl a vectT™ < ;^r S 1 in ex P res9i °" are drably converted to tristimulus values 

describing vectors in tristimulus space using a "tristimulus operator", T, such thatTTEfWl = x where * « tZ 
three-vector containing the tristimulus values XYZ corresponding to Eft) If T [S,fWS a i - * «n2V re ™ 
^.thenappnyingthetrist^uiusoperatortoboth^ 

H^)] = TI^^W S 2 (X) + CzSiV,)] (2) 
x= c^S^S^)] + CzTiSiiX)] (3) 

= C^X^ + CfcX-t (4) 

conv^ I^TT' 0 " 18 p8rformed ia an implementation decision, and the basis spectra terms may be 
converted to ^stimulus vector terms by the symbolic rendering system, after the ray tracing step aTin the 
^^J* °;. ,ater - as an ,n,tlal «««« 'n device ducted rendering sS> 90 Thff in^l o^ 
each p« e ,n the rendered image is thus defined, in the symbolic pixel expression as the sum of one or more 
of the tnshmulus vector terms. In the illustrated embodiment, then, color representation and maZulatl fe 

outtZ d r ,n ^ tr ' SBmU,US COl ° r 8Pa ° e m0da '- Cotar re P^entation and manlpulab^y Z be Sed 
out in other color spaces, since the tristimulus vectors may be converted further Into other color modete such 

In tS art ?° de,S ' T* RGB ° r HSV cotor m ° de,S ' throu 9" mathematical conveXn^eH kno^J 

which I a ^°T Bin3 , C ° n8ideratU>nS mUSt bB teken ,nto account - however - * ■ "lor space isZS 

which is a nonlinear transformation away from the tristimulus color space model 

to a Th»^n. trated ^ b0d «u "* ° f the PfBSent inVenti0n is based on mathematical models shown in FIGS 3 
5ii2^7^r ,ne ^ rtK ? n °f them « h - n »««»'"«>«W»ta l»ndledaBanoptfcnlzatlon praUem. DabBrM^d- 

rf-cationstotheongmalcoiordescnptions in an efficient manner requires finding a set of optimal motions 
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determine the modified color descriptions. _ described in detail below, is summarized as 

™e mathematical 

follows. The model defines an orig.nal "^J^^SL basis spectra (color descriptions 84). Each 
Lted in "picture space". The picture ,s defined as a 6 the ^ are physical representanons erf 

Scrum may be scaled by a weight ^^^^S^T^^^^^"^ 
colors the weights must meet certain criteria, and so. of all we 9™ a d subset va | ld pl ctures in 

wWe^ 

^re space. Because a picture is a ^^^^ of the weights, and the subset of valid P-c- 
weighte, a valid picture may be expressed as a ^" u ° U ^ efines a9ubset ln picture space. A»targetp.cture 
r^defineasubsetinpicturespace.A^^^^ 
Is defined as a picture which has image P'^^^^n to the original Ideal image. There is some ee of 

p,cture may be found by applying a f^^S^XS^ P™ du ' es a ^ **" TL Ce 
weights which meet the following constramt* s.g p ^ meBts some 

these constraints. The deta»s of this model follow ^ rterms represent Individual colorcon- 

As noted above, in each symbol c P« JSnS pixel color represented by the expresstoa 

r^r v srte n ^ 

so scene influence the color In many individual Pixels. |n ^ oolor mod8 , k as tristimuU« 

Figures 3 and 4 illustrate the concept of »» x , simplified from the three-dimensional 

space Note that FIGS. 3 and 4 ^ te ^Tln^m thTvectors shown demonstrate only one of the 
model implemented In the illustrated f pediment and ^hat tne ^ ^ Ma of „, st lus 

possible symbolic expressions for a p«al. In I FI03, j^Sus space represents the gamut of a particular 
space. Within tristimulus space 120 a subset 122 d ^JjJ^L, L , in the image to be rendered .s repre- 
oLit medium, also denoted"G" in FIG. 3 ^a color of a l»K« a surfaC6i Ss , nium.nated by 

sTted by the vector in tristimu.us space 120 ^£ J™?^ den oted S S S, Apixel 124 in the rnage 
light source, L. in the image is represented by the product or . l to ^ of gamut 122 . 

has a color which is determined by the 8 V"™.^l??^^ de rocl Image out of gamut, the individual scene ^f 0 " 
Forthe case where the colorof any | pixe I ^/JSSgj, or both. In the symbolic pixel expression 
tra s for either the object surfaces (S S ) or the ight intensities^ i hti w> in order to bring the vectors 

Slch generated the out-of-gamut pixel, are ^^^^ain«lnHWp^"8^^«^ 
roresentingthescenespectraclosertothevo^meb^ description symbol or Index) m 

B Tgur^ 4 "l-trates how individual weig^^^^^^ 

of the output medium. Pixel 124 and gamut 122 are shown Mn the ^sam , p° ^ ^ into gamut 

S of FIG. 3. in the illustrated embodiment, a p.xdh defined b a single ^ in stimulus space 

tf the line along the vector intersects the device ^;™/ w applled to the vector would not be able 

were defined only by a single vector a.ong I in ««J^J« J* ^^ng „„. 124a. However, since plxcj 
to bring the pixel color Into gamut 1 22. since 1 be oor ; ect ed (I.e., brought Into 8-^22)1* 
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' color that has changed from P^^^S^^JT 9 , ™ ^ represente -23 

has been applied, the scaling results VnM «i I "V*™*™*" space. Because only a single weiah 
Pointofgamutl^ineffect^Z^^ 

its chromaticity. Pixel color 126 is d^r^ttZ Z ! * changing the brightness of the pixel color and not 
£P<^wei g mw 8 andsc^^ 
» 120, denoted w 8 w lSsSl . representing a iJTpSSS ij EEST ? product vect °"n tristimulus space 
ar Vtf°a™t 122. Pixel color128ls^ 

by gamut 122. apaD,e of B|IM **» in ^ selected output medium represented 

-"we^ 

« ^Presented as a component of ^dime« vecS TfiZEZ^t* "* **** fe "^"^cally 
dimensional Euclidian "weight space" B^Z«7h,> T V / artafcr "« of weights defines a point in an M 

function is physical.y L^TS^Sl^^J^ T * ^ S ° the 
°f™'havevaluesgrea te rthan1^ 

welgh^s?^ 

As a weight takes on values, it functions as a ™SSwS»^E^ component 260 in expression 270. 
assigned. In turn, the multiplies applied to t^ Ss ^Jc^Z^ ? mp0nant 260 to which tt « 

coio^r^^^ 

In scan-iine order, and p, de'noteS t ^ZT^IZ^* V *"* Mt1 ™ a 
The set of Image pixel colors evaluated hL ■* n corres P° nd ' r 'fl to one tristlmulus value at one olxei 
light .ntensity values M^SSSTS^SZ FES 2? T 8 '™ 8 ° the ^<55 
P cture fe a function of the sjectra, a pE^SStoT f Is defnedwhTh fan °?" ° f th * the 
P*els. The picture function Is denoted as p = «S P the suS 5?*™"* W " W * *° WStlmu,US va,ues 

=g ht,as,,^^ 
weig^n^rCa^ 

Jacobian matrix having dimensions of 3 N x Jwtere teeStT'T** " th8 p,Cture ** * a 

■vative off, with respect to w, (thejth c^^^J^^^f^ is *"° Partial der- 
linear, J, will depend on w. '»niorwj. mis Jacobian matrix is denoted J f . Because f is non- 

P + Ap = f(w + Aw) (6) 
Because p = f M , t(le approximation ^^isT^ <*> 

i ne linear approximation just described is ucph ^f\ n Itw ' u 
current picture function, p.. th'at are neetd I sS fy ° t Z picture 22 ° f "* h * ° f the 
P*. Target picture p- is also a function of a set of weighte des anaXS ^ represents the target picture. 
The target picture p- is produced by maooino th» idli 9 f f **** wel£,hts **' suoh th at p* = *>*) 
in more data,, be , 0 w). so p- mJS^^^*?? t0 the •«* of *■ **» AJU 
plemented embodiment, the target weights Xedeftaed to b^h. V ^1° " SUCh that P * " *"« lm- 

of distance between p* and tN ^icture f^ 

Thus, the linearapproximation ofthe picture funcBon s usedtoft u^?* ^ kn0Wn - slnce * = 
^esomemeasureofdistancebetweenp.andrpre 1 ^ 



EP 0 594 370 A1 



10 



15 



20 



25 



30 



Euclidian distance between them in >*"V^ "J^-lmagM or certain device gamuts. For example. 

stitute for p* in G is a desirable S TOdn ^^'°" s ion ^ three .dimensional tristimulus space, denoted 
The gamut of the designated output med urn ^ * its plxeis are In gamut All In-gamut pictures 
G 3 , that the device can render. A p.ch.re ■ J ject0 £ h , which maps a picture p, to 

form a subset, G, of picture space P. There existe a gamut p ^ e ^ h G 

the picture in G "closest" in Eudid-an d,ston« ^ j. Fj« 71 ^J^jJ^ p) ^r al. p in G. Note 
"closest" in Euclidian distance to p. Some picture p is tne p.« = g Q 

that gamut projector function n is the ^P^^ f^^iSnTS-i. * «» weights, w. 
Figure 6C illustrates one solut.cn to the stated problem, m „ „ . lied t0 the picture 

forthe picture thatminimizes d(p 0 P) ^ £ Q«J* £, gamut, but it may not be in P. Then, a 

Po to obtain the target p.cture p* = ^'Jjjjji u ' s * d t0 f ,„<, changes in weights, w, which move 
nonlinear minimization process at which defines the picture in G which 

picture po in Ptoward P *. The goal of these t» «^^^^ JJb. ,»,„„,, dapBn d.onJy on w. In effect, 
isthesrrttllestdistan^ 

the problem Is to minirmze afunction g(w) - d(p . W)Y wi™ w 

of nonlinear optimization techniques are ap >pncable to the ^JJJJ, spectra to produce an in-gamut 

The problem of finding the optimum •*/«^"*J™J ™ m picture £. an d an initial set of weights. 

picture can now be briefly restated in the fol ow ng form *~ d j Stan *' d(Po , p) over all p « P n G. 

w„. such that Po = <W. the problem is to f ^^^^^^2^?* L W such that p = *w). 

For a picture p to be in the set P n G, p must be . gam.* ^ n ™ h m . are asfollows . when the distance 
Thespecificstapsof the impleme nted ^^^^SSSSL method may be used to find W. 

«*i^«""*«^ h te ?_Y5^ w a «*; 1 H 3 h 6 - 

steps of the implemented method. 
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Steps in Gauss-Newton Method 


1. 


Evaluate J f at w h and let Api = P* - Pi; 




2. 


Choose step direction Aw, to minimize t|A Pl - J^w, II as follows: 




3. 


Aw, = J^Ap, where J<* is the pseudo inverse of J* 

Choose a step length, k, according to an estimate of how nonlinear f is; 




4. 
5. 


Let w, + i <- w, + kAw,; let p, + i <- «w, + 1);- 
|, ft he sequence (pJJ^convemed.ex^ 





Figureeillustrctesthatthes^^ 
est distencefrom p* vrfll be in G. Using the two steps us desor ^esute^ p c ^ 9^ ^ ^ ^ 

to h(Po). but Pl is not in 9 A <^£Z^^^^L weights, w. which move picture p. in 
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originally computed target pi*! ™ - t l Th ^ W W ^ p *' do " to «» 
Just described treats alfp in P n G as efuaJIv „Z n ' m , 9enera ' aqu " the initial one ' 7116 slrate Sy 
» fromtheoriginal image. •£« TnQJ ^hoUvef b Ba ^„wr ^17.' P,CtUreS ' W,th ° Ut re9art to th8ir d,s * a "^ 
as Hs goa, finding the p In PnTwhth^ 

uses^m^^^^ 

gamut pixel colors. First, in box 130 S^2S^1T U " '^T^ ° 0, " totonl C0,0r ima 9 e »* h in " 
» signed a variable np^J^ti^^^^^^ **** W**'™ 80 is as- 

anequatlon in t^^EqSLZ^mS^S^ £l ^ f ° r Sa ° h pbcel expressio " 

are also Initialized from the InrTsDecta T^e in™ 8 P ,x «l colorval «e as afunctfon of the weights. The weights 
weights are stored in a vector w T^e SuSno s^ed ^ ^ 8 VeCt0r and the values for 

n,(X) Is an llluminant the vaEe of ^^nS^S?" ™ * T ^ S ' " the ' npUt Speotrum - 
« <- n,. The values for input BpWSS^^rS, ?*„" t' > " etto °" e and the «. 
Otherwise, the Input specfruT^W is a "e P os,tiv e , and may be greater than one (1).' 

faH between zero and onT , and'sc The ^ f ° f 8 SP6C,rum whloh fe a Stance must 

spectra value, and the ££££ %Z ^ S2SS"* hl W ' !? ,nlt,a " y 8et to the "<P" 
spectrum Is one (1) ' '' ' the ,ar9B8t value a ™«y take on for a reflectance 

20 threst,^^ 

the user or otherwise entered into memory a^Tpomt * reqUeSted """"^ fr ™ 

reprl^dS^ 

with modifications for handling the S ^ T""! to eVa ' Ua,i ° n StBp 82 in Fla *■ 

entire vector of values at this poW te theT^ nl^- ? ,f " 8pe0tral co,or '"formation. The 

Wcrenderingsyst^ - 

generate out-of-gamut pixel colors mm, h» m«wm w ■ \Z , h s y R,bo)lc P'**' expression 80 which 

ors at one time. In the illustrated embodiment a selection rfir^wS-!!- . ^ out -° f -9 amut CQ| - 

MsxriSr-^ =assssss 
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20 



and inner .oop,— ^^ 

steps needed for minimizing the goodness ta<^ wh«* in themus movements 

dian distance between two SSJ2£ •» -* <"* el tWS Ml * C ° ntelnS 

of the pixels to movements of the weights. J ^ w ' ap '- no 

symbolic expressions w, for weights on the between ^ p icture8 may take several 

in box 142, po is now denoted as p h since wSShte are adjusted. In box 142, p„ the set 

iterations of the inner loop, and with each terabon *^"^^™ t ". we ghte . These evaluated pixels 
of the ft worst pbcels. is evaluated with respec J™£^ function, n, which may be any con- 
are then mapped to the dev,ce gamut m ^ ^"^JJJ^ P picture p, produces a target picture p*. a list 

^^^^ 

computed, using any standard techmque, tofmd the 

picture closer to the target picture in p.cture space. In box 15 °- step slze ta k e S on a user-specified 
to how nonlinearpicture function f(w.) is In J^M* J*; ^fght changes computed from the 

ts whether the currerrt picture of the b worst P^ 

inquiry is made here because the "^.^^^SX^^P^^^^^^^^ 
asto how the current picture .s "conyergmg ™"r^J^i u ^ dffhm „c. between the current picture 
twotests. The first Is whetherthe absolute va^ 
» and the target picturels within a ^^^^J^SSmL is smaller than a user-specified quan- 
est change In the weights computed ^'J^^ 

tity, that is. too minimal to try another * e ™*°"*^™^Zn*sL\s not true, however, the distance function 
,oopisterminated,andp ro ce*sing — 

may be minimized further, and process m ) is transfer red ° ™ P pro0 essor-controlled machine, such as 
30 "The method of the present ^^^Z a dlgS computer as a component part In addition, 
a general purpose digital computer or a ^machine having a w p instructions which accom- 

the present invention may be a machine wh.ch ™ ,ud ° s ^ invention. Figure 10 Illustrate a machine con- 
plish substantially similar result^^^^^ 
figurauonforwhichthepresentmethod^ 

block diagram illustrating the components o 1^^^°^ er . based graphics workstation, which Is su.t- 
System 200 may be a standalone system, such h« a ™^S^i cflp tton.?he nnctoring ofthe UW w»h 
rt. for performing the scene modelmg and «^^^£ tion , P mrth od 90 of the present invention, 
a symbolic shaded rendering system, the spec* ™ e componen ts of system 200 include a 
and display of the in-gamut final color Jmage on Jj^^^™^. R P OM and RAM in which are stored 

symbolic pixel expressions 80 and ^J^J^ S t0 and in communication with a respective memory 
In system 200. processor 204 » conne t oted ^^!^ factions and the retrieval of data from the mem- 
unit, and processor 204 controls the the transfer of pixel information 
ory. Processor 204 may be any appropriate pi»w U |r ' which includes output unit 49. 
signals representing pixel image data from "^mory to output crcui try w n interactin g wlt h a scene 
input unit 206 may include any ^* d ^2S^S3ir ^Suitable devices include but 
modeiing application, a rendenng ^ and three-dimensional displays, such as a mouse 
arenotlimitedtopoinflngandcursorcontro and touch screen displays, 
orlight pen. alphanumeric input dev.ces such as ■ 'jgjjj "Snnected color device suitable for dlsplaymg 
The output units of system 200 may be «WWJJ* S (CRT) raster scan color monitor or a color 
computer generated color image data, " * ^ce of display 49 include color reproduction 
66 liquid crystal display. Other dev.ces suitable engin e, platemaking device, orothersuit- 
devices, such as an electronic or digital printer, ^^^^rnmunications device for connecting 
able color rendering device. «" additio" he output un, t may b a d* ^ ^ ^ of tne 
to a communications line, as shown .n FIGS. 11 and 1 *, wner y 
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through communications Hnk 209 wMch m»v Z !n « f ' Sy8tem 200 ls to system 210 

tween the two mach es Systfm 2 S' wh K L a ^1°°" ^T* f~ lcaH ° ns be- 

system instructions 25 to generate symbol S^SS^tJ?S2^ TT* ^ 

which together represent the data needed for a nl^»»f , deXed °° lor descr >P«°n data 84. 

202. Processor 2W contrJs the c»^^^ «> °r image, and which may be stored in memory 

Hon data 84 to receiving system VoZ^Z?^^™ 1 ^^™™* 80 and ,ndexed «>lordescrip- 

receMngsystemllOwhTh^ 

presslon fi.e 80 and indexed c^ descSrS 

executes spectral change calculation ^^iJ^anl^ thr ° U9h comm «""«aons link 209, and 

to produce the in^amuUmlg pS ^rS^enZ^^ J*? e ^ tesston eva| uator '^lons 82 
on output display 49 of system 210 ' SP ' ayin9 ' he rendered c °'° r "™9e 

■t^l^uS!^^ ^ '? »T ,S " ,ustrated another machine 

PossS™^ *-* —tion are a,so 

symbolicpixelexprLsioneviuatorMThf^^^^^ 
colors which areTn the gamut J 

the in-gamutimagepixei color data 46th roU gh^m2^ 



Claims 
1. 



2. 



A method of rendering a colour image from symbolic image data, comprising- 
The method of claim 1 wherein performing spectral change calculations includes the steps of 
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(d) determining whether the color Image satisfies an Imago mabrlc measuring a valid color Image In 

s£«£S££K2£ r«»i. » * - « - - 

color description data, 
in the target color image. 

Ar^hodofrenderlngacoloarMageltoms^ 

sr« =; irr,o?«r.h. «*» ™,=. . — ^ -» **• 

ence data; . : nrreme ntal change quantities whether the cur- 

(0 determining from the difference ^^^^,"^^^^,0^^^^ 
rent color image satisfies .mage metnc da ta the « ool o r irtia ge and the target color 

change quantities; w d fa upda a ng the current values of 

modified color description data. 

and the corresponding target color in the target color image. 

including: 

I ^^JSSXSL^a and storing data in the memory; 

^TZf^X^^ «— coior -esc^on data Kemdefining en origina. 

srocsr^^^^ 

^'tLgamutc^^ 

capable of reproduction by the device; and relat)onshi p between the plurality of image pixel color 
aataltlr^ 

'£7eS^ 

ponents; , w r ^^irnmoonent of each symbolic color image data item with 

tttt£2SSX2£ttZ£i* *i «- - — — — - 
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color image; 



ssssir" c "™ r " raw,n!i o ™ **• ip^fsssss 

7. A machine for rendering a colour image from symbolic image data, comprising- 

memory for storing data; 
fromtn^m^^^^ 

in the be ' nS C ° nneCted f ° r aCCSSSln9 d3te 8tored the - the da£ stored 

coiorre^r de"2 Sd rePreS8nan9 8 « d "'~ «- -P-* of reproduction by a 

instruction data Indicating Instructions the processor executes- 

CBSes 

E^XZtiSST PlUra " ty ° f — « - -«* «i output cJly'Vor 
2S^!l ne - 0f da ! m 8 ° r 9 Wherel " thS ° UtpUt med,um is < 1 > the «*»■ reproduction device havina the 

i^&zrjssziissr- 9amut - - — ~ in - ~; h h : 
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Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 
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□ GRAY SCALE DOCUMENTS 



□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 
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